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Abstract 

- - - We prove some stability results for smooth //-minimal hypersurfaces immersed in a sub-Riemannian ^-step 
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1. Introduction 

IiU Differential Geometry a minimal (hyper)surface of S." (or, of a Riemannian manifold (M", (•, •))) 
is a smooth codimension one submanifold having zero mean curvature. We recall that the Riemannian 
mean curvature TYr of a hypersurface S is the trace of its 2nd fundamental form Bk, which is the C"- 
bilinear form defined as Br(X, Y) := (VxY,v) for every X,Y e X{TS) := C°°(5, TS), where V denotes 
the Levi-Civita connection on the ambient space (either R" or M) and v is the unit normal vector along 
C^ i S . Note that *//« = -divrs v. Minimal hypersurfaces turn out to be critical points of the Riemannian 

(n - l)-dimensional volume cr'^"^ and hence, studying stability of a minimal hypersurface S means to 
study conditions under which S turns out to be a minimum of the functional o"^~^ For this reason the 2nd 
variation formula of cr^~' becomes a fundamental tool and, in order to avoid boundary contributions, we 
can use compactly supported normal variations of S . For an introduction to these topics in the Euclidean 
and/or Riemannian setting we refer the reader to the surveys by Chem 11211 . Lawson 07] and Osserman 
lIHTl : see also Simons' paper [71]. Finally, for some results concerning stability of minimal and CMC 
hypersurfaces, we would like to mention the papers fTOl, iTT"], f28l, fST]. 

That of Minimal Surfaces is one of the great chapters of the XX century Mathematics, above all, 
because was a rich source of entirely new ideas and theories such as that of Currents, introduced by 



'F. M. has been partially supported by the Fondazione CaRiPaRo Project "Nonlinear Partial Diiferential Equations: models, 

analysis, and control-theoretic problems". 

^The author wishes to thank the anonymous referee for many helpful comments that improved the paper 
-I 
Warning: In this new version, I have corrected some imprecisions and, more importantly, I have removed the last section 

of the previous version. The reason for this change have been some non-trivial modifications to the preprint [57]. No other 

substantial changes have been made. 

1 



2 Francescopaolo Montefalcone 

Federer and Fleming ||30l (see Federer's fundamental treatise |[29l ). that of Sets of Finite Perimeter 
created by De Giorgi and its school starting from the pioneering work of Caccioppoli (see the book by 
Giusti ||38l or ||3l), and that of Varifolds, heavily inspired by Almgreen and developed by Allard in |[T]|2]. 
A highly recommended introduction for these topics is, of course, the book by Simon |70|; see also the 
survey by Bombieri [14| and Morgan's book ll60l . 

In this paper, we study some of these problems, in the sub-Riemannian setting of Camot groups. We 
recall that a sub-Riemannian manifold is a smooth n-dimensional manifold M, endowed with a non- 
integrable distribution H c TM of /j-planes, called the horizontal bundle, on which a (positive definite) 
metric gH is given. The horizontal bundle H satisfies the Hormander condition and this implies the 
validity of Chow theorem so that, different points can always be joined by horizontal curves (i.e. curves 
that are everywhere tangent to H). The idea is simply that, in connecting two points, we are only allowed 
to follow horizontal paths joining them. The CC-distance dn , is then defined by minimizing the gH - 
length of horizontal curves connecting two given points: this is the distance used in sub-Riemannian 
geometry. As an introduction to these topics, we refer the reader to Gromov |'40l, Montgomery [|58l . 
Pansu 1.621 l63l . Strichartz [.74.1 . In this context, Camot groups play a role similar to Euclidean spaces 
in Riemannian geometry. They serve as a model for the tangent space of a sub-Riemannian manifold 
and, further, represent a wide class of examples of these geometries. By definition, a k-step Camot 
group G is a ?i-dimensional, connected, simply connected and nilpotent Lie group (with respect to a 
group law • which is polynomial) having a k-step stratified Lie algebra g = R". This means that g splits 
into a direct sum of vector subspaces satisfying suitable commuting relations. More precisely, we have 
g = //i ® //2 ® • • • ®lik, [Hi, Hi] = Hi+i for every / = 1, ...,k- 1 and [Hi, Hi] = for every / > k, where 
the brackets [•, •] denote Lie brackets. We assume that hi - dim//,- (/ - 1, ...,k) so that n = X,=i hi- The 
stratification of g can be seen as the algebraic counterpart of the Hormander condition. 

We recall that Camot groups are homogeneous groups, in the sense that they admit a family of positive 
anisotropic dilations modeled on the stratification; see f73l. This richness of geometric structures, makes 
interesting the study of Geometric Measure Theory in Carnot groups; see, for instance, [4J, [5J, [6J, |J9], 
l|2a,||3a,|l33[32|3l|3a,||5l|55l|53,||50l|5BI^,ll5^ bibliographies therein. We also cite lUS], 
0[Il,l[Il,ll23|23,||37l, 111, llSl.lill, 1671 for many important results concerning //-minimal 
and/or constant horizontal mean curvature (hyper)surfaces of the Heisenberg group. Nevertheless, here 
we have to remark that not much is known about the geometry of smooth //-minimal hypersurfaces in 
general groups. 

The aim of this paper, which is somehow a continuation of f56l, is studying the stability of smooth 
//-minimal hypersurfaces immersed in /c-step Camot groups. Let us briefly describe our results. 

In Section [TTTl we fix notation and main definitions conceming Camot groups. We use a left invariant 
frame X := {Xi,...,X„} on g adapted to the stratification and fix a Riemannian metric (•,•) making X 
orthonormal (henceforth abbreviated as o.n.). This frame satisfies some non-trivial commuting relations 
encoded by the so-called structural constants C^^ • := ([Xi,Xj],Xr) yi,j,r = l,...,n. Note also that 
the (uniquely determined) left invariant Levi Civita connection V can be expressed in terms of structural 
constants. The projection of V onto the horizontal space H is denoted by V" and called horizontal 
connection. 

In Section 11.21 we recall basic facts about immersed hypersurfaces endowed with the //-perimeter 
measure cr^"^. Note that cr'^^^ = \Phv\ cr'^'^ , where cr,^"^ is the {n - l)-dimensional Riemannian measure, 

V is the unit (Riemannian) normal along S and Ph is the projection onto //. Let v^ - j^^ be the unit 
horizontal normal along S and let HS c TS be the horizontal tangent space, which is (/j- l)-dimensional 
at each non-characteristic point p e S \Cs, where Cs := {p e S : \Phv\ = 0) denotes the characteristic 
set. It turns out that Hp - HpS ® span^lv,j{p)} at each p e S \Cs- This allows us to define the horizontal 
2nd fundamental form by setting Bh (X, y) :- (V^F, y„\ forevery X, 7 e C^{S,HS). However, this object 
is not symmetric, in general. Thus it can be decomposed in its symmetric and skew-symmetric parts, i.e. 
Bh — S h + Ah ■ 
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In Section|2]we discuss some divergence-type formulae, which are very important tools. In particular, 
these results enable us to define the horizontal tangential operators Dhs and £.hs , which are analogous, 
in this SR setting, to tangential divergence divrs and Laplacian An . An important fact is the validity of 
the formula 



■ I ifLns ipcr'l^ ^ I \gradHs f\^ crl 
Js Js 



for every compactly supported function (fi e Cj^CS \Cs) (^ W^'^ (5;cr^~^); see Corollary 12.81 and also 
Remark IZ91 This formula holds (a fortiori) whenever 99 € C^{S). 

In Section 12.11 we discuss the basic calculations needed to prove the 1st variation formula for the 
//-perimeter c^"'. 

Section [3]contains some other tools: adapted frames, connection 1-forms and lemmata concerning the 
horizontal 2nd fundamental form Bh. This material is then used in Section |4] to discuss and prove the 
variational formulae for cr^"'. The presentation here is slightly different from [56 1. In fact, we have tried 
to simplify the original proofs. More importantly, we have corrected a mistake that has caused the loss 
of some divergence-type terms in the variational formulae proved there; see Remark 12.141 Furthermore, 
we have extended the formulae to the characteristic case. 

We say that a hypersurface S of class C^ is H-minimal if its horizontal mean curvature 'Hh is zero at 
each non-characteristic p e S \Cs- Moreover, it turns out that the "infinitesimal" 1st variation of cr'lf^ is 
given by 

Z^a^l^ = [-q-l^{W,v) + divrs (w^\'Phv\ - (W,v>yj)) <-\ 

where XwO"""^ is the Lie derivative of o"^"^ with respect to the initial velocity W of the variation and the 
symbols W""", W^ denote the normal and tangential components of W, respectively. If "K/y is L^{S ; cr?^^), 
the function Xvi^crJJ"' is integrable on 5 and the integral of Xwc^ ' 011 ^ gives the 1st variation of cr^~^ 
Note that the third teiTn in the previous formula depends on the normal component of W. We stress that 
this term was omitted in [56|. Using a generalized divergence-type formula, the divergence term can 
be integrated on the boundary and, if one use compactly supported variations, it follows that //-minimal 
hypersurfaces are "critical points"of the //-perimeter functional. 

The formula for 2nd variation of cr^~\ which is one of the main results of this paper, will be obtained 
as a result of a long calculation; see Theorem 14.121 This formula will be proved under some further 
assumptions concerning integrability of some geometric quantities. For a precise statement, we refer the 
reader to Section |4] In the Heisenberg group H\ the 1st variation formula for characteristic surfaces of 
class C^ was first obtained by Ritore and Rosales in ll67l . We also stress that Hurtado, Ritore and Rosales 
||44]| have proved a formula for the 2nd variation which is analogous to that stated in Theorem 14.121 We 
also quote [43], for similar results in a general sub-Riemannian setting. 

Using compactly supported variations together with suitable integrability conditions on the function 
■^—;, the 2nd variation formula takes the following simple form 



Us {W, ct7^) = f {igrad^s wf - w^Srs ) 



TS CTh 



where W is the variation vector and w = m^i- Here, we have set 



Sts ■- ||^«|li+||A„||i + Y, {[2grad,s (rua) - Cim) (X„ - tu.vJ] , C%„) ; 

=\\Bh\\1,. 

see Corollary 14.131 Definition 11.71 and Definition 11.91 in Section 11.21 Note that the above expression 
involves many geometric quantities such as the horizontal 2nd fundamental form Bh (or, its symmetric 
and skew-symmetric parts Sh and A«), the vertical vector field m, defined as m := ^^ = Z"=/,+i '^aXa, 
where m^ '■= i^^. and the matrices of the structural constants C" and C{m) = J^aeiv '^aC" ■ 
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In Section |5] we state some further identities for constant horizontal mean curvature hypersurfaces. In 
particular, we find a family of explicit solutions to the equation 

£hs (f + ip Sts - 0. 

This is a key-point of this paper and, using this fact, the main stability inequality follows by adapting a 
standard argument in the Riemannian setting; see, e.g. IIBTI . In Section [6] we prove the following: 

Theorem 1.1. Let S c G be a H-minimal hypersurface of class Q?. If there exists a € Iv = {h+ I, ..., n) 
such that either xua > or Wa < on S, then each non-characteristic domain Q. c S is stable. 

An immediate application of the previous result is contained in the next: 

Corollary 1.2. Let S c G be a complete H-minimal hypersurface of class C^. If S is a graph with 
respect to some given vertical direction, then each non-characteristic domain Q. c S is stable. 

Finally, , in order to illustrate our results, an analysis of some (more or less simple) examples is given 
in Section [6?T1 see, more precisely. Corollary 16.81 Corollary 16.91 and Corollary 16. 121 

I.I. Carnot groups. A k-step Camot group (G, •) is a connected, simply connected, nilpotent and 
stratified Lie group (with respect to a group law •) so that its Lie algebra g = K." is a direct sum of slices 
g = //i ® ...®Hk such that [Hi,Hi-\] = Hi (/ = 2, ...,k), Ht+i = {0). Let be the identity of G and set 
hi := dim//,- for / = 1, ..., k and hi := h. Moreover set H := Hi and V := //2 ® ... ® Ht- Note that H and 
V are smooth subbundles of TG called horizontal and vertical, respectively. The horizontal space H is 
generated by a frame Xh '■= {Xi , ..., X/,) of left-invariant vector fields, which can be completed to a global 
graded, left-invariant frame X := [Xi,...,X„} for g. We stress that the standard basis {e,- : / = 1,...,?!} 
of R" = TqG can be relabeled to be graded or adapted to the stratification. Note that any left-invariant 
vector field of X satisfies Xi{x) = Lx*e.i{i = 1, ...,«), where L^,. denotes the differential of the left- 
translation at X € G. We fix a Euclidean metric on 1." = ToG which makes {e,- : / = 1, ..., n} an o.n. basis; 
this metric extends to each tangent space by left-translations and makes X an o.n. left-invariant frame for 
g. We denote by g = {■,■) this metric and assume that (G, g) is a Riemannian manifold. 

We use the so-called exponential coordinates of 1st kind so that G is identified with its Lie algebra g, 
via the (Lie group) exponential map exp : g — > G. 

A sub-Riemannian metric gn is a symmetric positive bilinear form on the horizontal space //. The 
CC-distance dn {x, y) between x, y e G is given by 



I ^gnij,: 



dn (x, y) : = inf I yg« (y, y) dt, 

where the infimum is taken over all piecewise-smooth horizontal paths y joining x to y. From now on, 
we shall choose gn := g\H. 

We recall that Carnot groups are homogeneous groups, i.e. they admit a one-parameter group of 
automorphisms 6t : G — > G for any ? > 0. By definition, one has 6tX :- exp [Y^jj t^ Xi.&iA , for every 

X - exp [Tjj,i ^i^i) £ ^- The homogeneous dimension of G is the integer Q :- YJi=i ' ^z coinciding with 
the Hausdorff dimension of (G, </« ) as a metric space; see BOl . ll58.1 . 

The structural constants of g associated with X are defined by C^J,- := ivXi,Xj\,X,-) , i,j, r - \, ...,n. 
They are skew-symmetric and satisfy Jacobi's identity. The stratification hypothesis on g can be restated 
as follows: 
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C" := [C%]ij=i_n e Mnxnim Wa = h + l, ..., n. 
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Now we introduce! the left-invariant co-frame w := {ajj : / = 1, ...,«) dual to X, i.e. a»; - X* € Q^( 
for every / = 1, ..., n. In particular, note that the left-invariant 1-forms co/ are uniquely determined by 

oJiiXj) ^ (Xi,Xj) ^ 3j 



V /,;•= \,...,n. 



where 5^ denotes the Kronecker delta. 

Let V denote the (unique) left-invariant Levi-Civita connection on i 
metric g = (•,•>. It turns out that 



associated with the left-invariant 



1 " 



\fX,Y € Ji{H) := C"(G,//), we set V^F := f«(VxF). The operation V" is a partial connection 
called H-connection. We stress that V" is flat, compatible with the metric gn and torsion-free (i.e. 
V^F - W"yX -Ph[X,Y]=OW X,Y e X{H)y, see ES] and references therein. 

Notation 1.3. IfX e X^{TG) := C'(G, TG), we denote by J'kX the Jacobian matrix ofX computed with 
respect to the left invariant frame X = {Xi, ...,X„}. Moreover, ifX € X^{H) = C'(G, //), we denote by 
J'kX the horizontal Jacobian matrix of X computed with respect to the horizontal left invariant frame 
Xh ^ {Xi, ...,Xh}; see \56\. 



R/y is identically zero, where we recall that R//(X, Y)Z :- VyV"Z - V"VyZ 



Remark 1.4 (Horizontal curvature tensor Rh). The flatness ofl" implies that horizontal curvature tensor 

H^H7_^H^H7_ y«^^^^^ ZforX,Y,Z^ X{H) . 

Horizontal gradient and horizontal divergence operators are denoted by grad^ and divH . 
A continuous distance ^ : G x G — > IR.+ U {0} is called homogeneous if one has 

g(x, y) = g(z» x,z»y) W x, y, z€ G; g(StX, 6ty) = tg{x, y) V? > 0. 

We recall a fundamental example. 

Example 1.5 (Heisenberg groups H"). The Lie algebra I)„ = 

be deflned by using a left-invariant frame {X\,Y\, ...,Xi,Yi, ...,Xn,Yn,T}, where Xi{p) :- ^ ~ 2^^' 

^iip) •= ^ + 7^/o'"^very / = 1, ...,n, and T{p) :- ^. Here p = exp{xi,yi,X2,y2, ■■■,Xn,yn,t) denotes 



2n+i qJ fj^g yi^ij^ Heisenberg group can 

dx, 



the generic point in H". One has \Xi, F,] = T for every i - 1, ...,n, and all other commutators vanish. 
Hence, by deflnition, T is the center of I),, and f)„ turns out to be nilpotent and stratifled of step 2, i.e. 
l)n - H 9 H2. The structural constants of I)„ are described by the skew-symmetric {2n X 2n)-matrix 



2n+l ._ 



C: 



associated with the skew-symmetric bilinear map Th : H X H 
every X,Y e H. 
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. given by r«(X, F) = {[X, F], T}for 



1.2. Hypersurfaces and measures. The Riemannian left-invariant volume form on G is defined as 
o"^ := /\"^i ojj € n"(G). The measure alj^ is the Haar measure of G and equals the push-forward of the 
usual n-dimensional Lebesgue measure £." on K." = TqG. 

Let S c G be a hypersurface of class C^ We say that jc € S is a characteristic point whenever 
dimHx = dim{Hx n TxS). The characteristic set of 5 is defined as 

Cs -{xeS :dimHx = dim{Hx n T^S)}. 

Note that ;c e 5 is non-characteristic if, and only if, H is transversal to S at x, i.e. Hx fti TxS . We here 
observe that the (Q - l)-dimensional CC Hausdorff measure of the characteristic set €$ vanishes, i.e. 



Notation. Let M be a smooth manifold. We shall denote by n*(M) the space of differential ^-forms on M. 
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'^cc ^^^^ ~ ^' ^^^ 1^^" ^^ ^^'^^' ^^^^^ further regularity assumptions, it is possible to show much more 
than that. For instance, if S is of class C^, then the (n - l)-dimensional Riemmanian Hausdorff measure 
of C5 is zero; see 112]. 

Let V denote the unit normal vector along S . The {n - l)-dimensional Riemannian measure is defined 
as (t!^'^ := (v J cr^)l5, where J denotes the "contraction" operator on differential forms; see Lee's book 
Il48l . pp. 334-346. We recall that J : Q^G) -^ a''-\G) is defined, for X € X{TG) and a e a'^(G), by 
setting 

(X J a)(Fi, ..., Yt-i) ■- a{X, Fi, ..., Yk-i). 

At each non-characteristic point of S the unit H-normal along S is the normalized projection of v onto 
H, that is v„ := i^^. The H -perimeter form is the {n - l)-differential form cr^~^ on 5 \ C5 defined by 

crr':=(y„JOIs\Cs- 

\iCs *% we extend cr"-'^ to the whole of S by setting cr^"^ L C5 = 0. Note that cr"'^ = \Ph v\ cr^^'^ . This 
follows from the well-known formula (X J cr1)\s = {X, v) (t"i^^ for any X € 3t*(rG). In particular, it turns 
out that Cs = [x ^ S : \'Phv{x)\ - 0). Let S^~ be the {Q - l)-dimensional spherical Hausdorff measure 

associated with the CC-distance dn. Then cr^'^C^ n B) = k{v^)S^^\s n B) for all B € Sor(G), where 
the density ^(v„), called metric factor, depends on y^; see ll50ll . The horizontal tangent bundle HS c TS 
and the horizontal normal bundle v^S split the horizontal bundle H into an orthogonal direct sum, i.e. 
H = Vjj ^ HS . We also recall that the stratification of g induces a stratification of TS := ^'l^-^HjS, where 
7/S :-//i5;see|401. 

Remark 1.6. We have dimHpS - dimHp — \ = h— \ at each point p e S \ C5 . Furthermore, note that 
the definition ofHS makes sense even if p e Cs, but in such a case AiraHpS - dimHp - In. 

For the sake of simplicity, in the rest of this section we shall assume, unless otherwise mentioned, that 
S c G is a non-characteristic hypersurface of class Q}. So let V" be the induced connection on S from 
V. The tangential connection V" induces a partial connection on HS defined by 

V^^ Y ■- Phs (vJ' y) V X,Y€ X\HS) ■- C\S,HS). 

It turns out that V^^ F = V^F - (V^F, v^W„. In the sequel, //5 -gradient and //5 -divergence will be 
denoted, respectively, by gradns and divns . By definition, the horizontal 2nd fundamental form of S is 
the bilinear map given by 



B«(X,F):-(v^Fv„) 



foranyZ,F€ X^{TS). The horizontal mean curvature TYh isthe trace of Bh, i.e. 'Hh := TiBh = -divnv^. 
The torsion Ths of the //5 -connection V"^ is given by T«s {X, F) := Vf F - V^'X - Ph [X, F] for any 
X,Y e X\HS). There is a non-zero torsion because, in general, Bh is not symmetric. Hence Bh can be 
regarded as a sum of two matrices, i.e. Bh = Sh +Ah , where Sh is symmetric and A« is skew-symmetric. 

Definition 1.7. The principal horizontal curvatures kj of S, j e Ihs, are the eigenvalues of Sh, i.e. 
eigenvalues of the symmetric part of the horizontal 2nd fundamental form Bh. Note that fin - Tjieins '^j- 
We also define some important geometric objects: 

• tzTq, :^ 1^ ^ « = ^ + 1' •■•'«.■ 

• TZTHj .- 1^^ - luaelH^ ^a-^a, 

• ChCothj) :- YjaelH^ '^aC%; 

• C{tu) := Y^aelv ^a C". 

We further denote by Chs {tuhi) the restriction to the subspace HS of the linear operator Ch{'ujh2). 
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These objects play an important role in the horizontal geometry of immersed hypersurfaces. For 
instance, we have to remark that Ah - j Chs (ct«2); see |[56ll . Moreover, for any X,Ye X^{HS) we have 
Ths {X, Y) - ([X, Y], m)v„ = -(Cms {vjh, )X, Y). 

Example 1.8 (Heisenberg group). We have m :- tut - i^^ and Ch{vjh2 ) - mC^^^; see Example \1.5\ 
An elementary computation shows that the skew -symmetric part Ah of the horizontal 2nd fundamental 
form Bh is given by Ah = f C^f \ where C^f i = CI"+'^\hs- Since \\Clf%,. = 2{n - I), it follows that 

\\BH\\i=\\SH\\i+^Vjl 

Definition 1.9. Let U Q G be an open set and let tl := S D U. We call adapted frame to 1/ on [/ any 
o.n. frame r := {ti, ...,t„) on U such that Ti(p) := v^{p), Hptl = span{T2(jP), ...,Th(p)}for any p etl, 
Ta '.- Xa- Furthermore, we setr^ := Ta-TUaTiforany a € Iv. We stress that HS -'- - spanj^jr^ : a e Iv], 
where HS''~ denotes the orthogonal complement ofHS in TS, i.e. TS = HS ® //S""". 

Note that every adapted o.n. frame to a hypersurface is a graded frame. Clearly, we have that 

1=1 Ti , T2,...,T/, ,T/i+i, ...,Tn }. 
=v^ o.n. basis oi HS o.n. basis of V 

Notation 1.10. Let ni := ^':^ihj. Hereafter, we shall set In - {1,2, ...,h}, /«, - {?i,_i + 1, ...,?!;), 
Iv = {h+ 1, ...,n} and Ihs '■- {2,3, ...,h}. 

Let (f) := {01, ..., 0„) be the dual co-frame of t, i.e. (piiTj) = 5-'. for any /, j - 1, ..., n, where 6^. denotes 
the Kroneker delta. The co-frame (p satisfies the Cartan's structural equations: 

n n 

(3) (I) d(Pi = 2] (Pij A (Pj, (II) dcpjk = Yj 'Pjl ^ 'Pik - "^jk 

j=l 1=1 

for any i,j,k = 1, ...,n, where (pijiX) := (VxTy,T,\ denote the connection 1-forms of (p and O^^ denote 
the curvature 2-forms, defined by ^jk{X, Y) :- (/>i(R(X, Y)tj) for any X,Y e X(G), where R is the 
Riemannian curvature tensor, that is 

R(X, Y)Z := VyVxZ - Vx'^yZ - ^\y,x\Z 

for any X,Y,Z ^ X(G). The following holds 

(4) C\j := ([t,-, Ty], T^ = (PjkiTi) - (PiuiTj) V /, ;, k=\, ..., n. 

This identity can be proved by using the fact that V is torsion-free. 

Definition 1.11. A vertical hyperplane I is the zero-set of a linear homogeneous polynomial on G of 
homogeneous degree 1. A non- vertical hyperplane J is the zero-set of a linear polynomial on G of 
homogeneous degree greater than or equal to 2. 

Hyperplanes are {n - l)-dimensional vector subspaces of g. The importance of vertical hyperplanes 
comes from the intrinsic rectifiability theory developed by Franchi, Serapioni and Serra Cassano in 2- 
step Camot groups; see [32] |33] |34] |35J. They turn out to be ideals of the Lie algebra g and may be 
thought of as generalized tangent spaces to sets of finite //-perimeter (in the variational sense); see (6]. 
Non- vertical hyperplanes will be studied in Section l6n 

2. Divergence formulae 

Let S c G be a hypersurface of class Q?. For the sake of simplicity, we first assume that S is non- 
characteristic. Let CJ^i (5 ), {i - 1,2) be the space of functions whose HS -derivatives up to the /-th order 
are continuous on S . Analogously, for any open subset 'ZY c 5 , we set CJ^^ {'U), to denote the space 
of functions whose HS -derivatives up to the /-th order are continuous on tl. The previous definitions 
extend to the case €$ 9^ by requiring that all HS -derivatives up to the /-th order are continuous on Cs ■ 
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Remark 2.1. The notions concerning the HS -connection V"*, the horizontal 2nd fundamental form Bh 
and the torsion Ths, can also be formulated by replacing X^{HS) = C\S,HS) with the larger space 
Xl{HS)-Ci,{S,HS). 

Definition 2.2 (//5 -differential operators). Let Dhs : ^IsiHS) — > C(S) be the 1st order differential 
operator given by 

Dhs X : = divHs X + {CH{mH^)v^,X) W Xe 4s (HS ) . 

Moreover, let Dhs : C^^ (S ) — > C{S ) be the 2nd order differential operator defined as 

£hs (f := A«s (f + {Ch {tuh^ )v^ , gradns f) V ^ € C^i- {S). 

Note that Dhs ((pX) = ipDns X + (gradns <p, X) for every X e y}{HS ) and every ip e C^^. [S ). Moreover 
£,Hs if = Dhs {grades f) for every ip e C^^, {S ). 

It is not difficult to see that the operators Am and X«5 naturally extend to horizontal vector fields. 

These extensions will be denoted by Am and £.hs ■ We remark that 

£hs X ^ Ahs X + {Jhs X) Ch (tZJH, )v^ 

for every X e C J^ {S \Cs, HS ), where J'hs X denotes the HS -Jacobian matrix of the horizontal tangent 
vector field X. 

We now define a homogeneous measure o"^~^, which plays the role of the intrinsic Hausdorff measure 
on (« - 2)-dimensional submanifolds of G. 

Remark 2.3 (The measure cr^~^). Let rj € ^{TS) be a unit normal vector orienting dS . Further- 
more, let rjHs := m^^\ be the unit //S' -normal of dS . By definition, we set cr'^~^ := (tjhs J crJJ^M |^^. 
Exactly as for the H-perimeter cr'^~^, the measure cr^f^, which is {Q — 2)-homogeneous with respect 
to Camot dilations, can be represented in terms of the Riemannian measure cr?^^. In fact, we have 
a"-^ = \pHv\\pHs-n\(T"-^\_dS. 

The above definitions are somehow motivated by Theorem 3.17 in |[56l . 

Tiieorem 2.4. Let S (zG be a compact non-characteristic hypersurface of class C^ with (piecewise) C^ 
boundary dS and X € X\TS). Then 

fDHsXcTr'= f {X,r]Hs)K~^. 
js Jas 

As a consequence, the following integral formula holds 

(5) r DhsXo"-^ = r {divHsX + {CH{mH,)v^,X)) a"-^ = 

Js Js 

for every XeCl{S,HS). 

Stokes' formula is concerned with integrating a ^-form over a ^-dimensional manifold with boundary. 
A common way to state this fundamental result is the following. 

Proposition 2.5. Let M be an oriented k-dimensional manifold of class Q} with boundary dM. Then 
J^ da - L^ a for every compactly supported (k — \)-form a of class C^ 

One requires M to be of class Q? for a technical reason concerning "pull-back" of differential forms. 
We remark that it is possible to extend Proposition 12. 5 I to the following cases: 

(•) M is of class C' and a is a (k — \)-form such that a and da are continuous; 
(♦) M is of class C^ and a is a{k— \)-form such that a € L°°{M), da € L^{M) -or da e L°°{M)- and 
fj^a € L'^{dM), where im '■ dM — > M is the natural inclusion. 
Many different versions of Stokes' theorem are available in literature; see, for instance, [29 1. For an 
introduction, we refer the reader to the book by Taylor [|75l ; see Appendix G. 
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Remark 2.6. General versions of Stokes' theorem can be deduced from the generalized Gauss-Green 
formula proved by De Giorgi and Federer; see II27II or II29II , Theorem 4.5.6, p. 478. However, it is 
worth observing that they hold for Lipschitz differential forms. A general result of this type can be found 
in Maz'ja' [i53il . see Section 6.2. We observe that (•) holds for any compact oriented k-dimensional 
manifold M with boundary and for differential forms that are Lipschitz at each point of M\ T, where 
T is a thin subset of M; see 1165 1 , Remark 5.3.2, p. 197. On the other hand (♦) is perhaps less known 
that (•). The validity of (tt) is observed in 11751 , • see formula (G.38), Appendix G. This result can be 
deduced by applying a standard procedur^from a divergence-type theorem proved by Anzellotti; see, 
more precisely. Theorem 1.9 in [7|. More recent and more general results can also be found in the paper 
by Chen, Torres and Ziemer EOl . 

We have here to remark that either condition (•) or (♦) can be used to extend the horizontal integration 
by parts formulae to vector fields (and functions) possibly singular at the characteristic set €$ . 

Definition 2.7. Let X e C^^ \Cs,HS) and set ax ■- {XJ o-'^'^)\s. We say that X is admissible (for 
the horizontal divergence formula) if the differential forms ax and dax satisfy either condition (•) or (♦) 
on S. We say that (f> € C^^ (S \Cs) is admissible ifgradus (f> is admissible for the horizontal divergence 
formula. More generally, let X e C^{S \ Cs,TS) and set ax '■= (X-i cr'^~^)\s- Then, we say that X is 
admissible (for the Riemannian divergence formula) whenever ax and dax satisfy either condition (•) 
or (♦) on S. 

Using Definition 12.71 and Theorem 12 .4 1 yields the following: 

Corollary 2.8. Let S c G be a compact hypersurface of class C^ with C^ boundary dS. We have: 
(i) J^ Dhs Xo-"-^ = J^^ {X, T]Hs ) <"2 for every admissible X e C\S \Cs,HS); 

(ii) L -Lhs (p crlf^ = L (grades (f>, rjHs ) cr'^'^for every admissible (f> e Cj^ {S \ €$ ); 
(iii) ifdS = 0, then 

(6) - { ^Zhs^oT' = { \grad,s<P? ct"-' 

Js Js 

for every function ip € C^^, {S \Cs) such that ip^ is admissible. 

Note that formula |6] holds even if dS 4^ 0, but in this case we have to use compactly supported 
functions on S . 

Remark 2.9. Let if e C^^ {S \ €$). If(fi^ is admissible, then 

if € W'J(S,C^^'') ^{cpe L\S,al-') : \grad,s^\ e L\S,(t7')] ■ 

Example 2.10 (Heisenberg group; see Example [LST l. One has Dhs{X) := divnsX + m(cl"'^^Vfj,x\for 
every X e X^ (HS ) and JLhs (f : - "Dhs (grades <p) = Am- (fi + m{Cl"'^^ v„ , grades <fi)for every tp € C^^ (S ). 

The following result will be used throughout the proof of Corollary 14.131 

Proposition 2.11. Let M be a compact oriented Lipschitz k-dimensional Riemannian manifold. Then 
\ divTidXa-.^ = for every X € Wcomp{M,TM), where cr,^ is the Riemannian volume and W^ompi^) 
denotes the Sobolev space of all square-integrable compactly supported vector fields on M with square- 
integrable first (covariant) derivative. 



This propoposition can be found in 11691 ; see Proposition 3.1, p. 7; see also 11581 . Section 4.3, p. 33. 



See, for instance, Federer II29I , paragraph 3.2.46, p. 280; see also L65J . Remark 5.3.2, p. 197. 
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2.1. Preliminary remarks concerning the 1st variation formula. 

Notation 2.12. Let S c G be a hypersurface of class C , i > 2. Let X € TG and let v be the outward- 
pointing unit normal vector along S . We shall denote by X""" and X^ the standard decomposition of X 
into its normal and tangential components, i.e. X""- - {X, v)v, X^ - X - X""-. 

We now make a simple (but fundamental) calculation. 

Lemma 2.13. If X e X\TG), then (X J o-r^)ls - ((x"^|;P«y| - <X,y>vj) J cr«-i)L 5. Moreover, at 
each non-characteristic point of S, we have 

d{XJ (T'ir^)\s = divTs {x^\Phv\ - <X,y>vj) crt^ L S. 
Proof. We have 

d{XJa'^-% = iXJv,JcTl)\s 

^ d{{x-^X-)j{y-^y-)jcr!^)\^ 

= 4x-jv-j<)|^+4v;jx-j<)|^ 

- d{x^Jcr",'%+d (vj J <X, v)(r",~') \^ 

- divrs {x'^I'PmvI - (X, v>yj) cr^-^ L 5. 

n 

Remark 2.14. The previous calculation corrects a mistake in t56], where the normal component of 
the vector field X was omitted. This has caused the loss of some divergence-type terms in some of the 
variational formulae proved there. 

We would like to stress that the importance of the previous calculation in the development of this 
paper comes from the well-known Cartan's identity for the Lie derivative of a differential form; see lITSl . 
ll48l . More precisely, let M be a smooth manifold, let oj e Q.^{M) be a differential ^-form on M and let 
X € X{TM) be a differentiable vector field on M, with associated flow 0, : M — > M. We recall that the 
Lie derivative of o) with respect to X, is defined by £.xco := ^^f ^L_q, where (p*oj denotes the pull-back 
of OJ by (pf. Then, Cartan's identity says that 

(7) £xOJ = (X J doj) + d{X J co). 

This is a very useful tool in proving variational formulae, not only for the case of Riemannian volume 
forms, for which we refer the reader to Spivak's book ||72l (see Ch. 9, pp. 411-426 and 513-535), but 
even for more general functionals; see, for instance, f4T\, f39l. In Section IH we shall apply this method 
to write down the 1st and 2nd variation formulae for the //-perimeter measure o-'/f^. But let us say 
something more about the 1st variation formula. So let 5 c G be a hypersurface of class C^. We remark 
that the Lie derivative of o"^~^ with respect to X can be calculated elementarily as follows. We begin with 
the first term in formula dTJ. We have 

X J Jcr^^ - X J J(v„ J o-^) = XJ [divv^a"^) - {X,v)divv^a"^-\ 

Note that div v„ - divn v„ - -"Hh . More precisely 

n h 

divv^ = ^<Vx,v„,X,) = ^XKv„,) ^ divHV^ ^ -"Hh. 

i=\ i=\ 

The second term in formula © has been already computed in Lemma [2. 131 Thus, we can conclude that 

(8) LxcJ^^' = (-•K«<X, y) + divrs {x^\Phv\ - (X, v)v])) a^-\ 
at each non-characteristic point of S . We will return on this point in Section 5] 



Stable //-minimal hypersurfaces 1 1 

Remark 2.15. Roughly speaking, formula ([8]) gives the "infinitesimal" 1st variation of the measure crl^'^. 
However, in order to integrate the function Xzc«~' over a C^ hypersurface S, we have to require that 
'Hh is locally integrable on S, with respect to the Riemannian measure cr"'^, i.e. 

(9) 'HHeLljS;cr'l-'). 

Indeed, in general, "Kh fails to be integrable locally around the characteristic Cs; see, for instance, 
II26I . Note that Q implies the integrability of the function XzO"""^- Clearly, if Cs = 0, then Q is 
automatically satisfied because, ifS is of class C^, then 'Hh £ C{S). 

Remark 2.16 (Riemannian case). We would like to stress the analogy with the 1st variation ofcr^^ for 
a hypersurface S of class C, i > 1, immersed in the Euclidean space R". It is well-known that the 1st 
variation formula is given by Isicr^'^) - L divrsW cr'^~^; see Simon's book iTOl , Ch. 2, § 9, pp. 48-53. 
In the C^-case, the variation vector W cannot be decomposed in its normal and tangential parts. Clearly, 
this can be done ifS is of class C^. In this case 

Is {o-'i~^) ^ r divTs W o-'l^ - f ({W^, v) divTs V + divrs W^) o-^^ ■ 

Note that -"Hk = divrs v. Hence, we have two contributions. The first is given by - L "Hr (W""", v> cr,^~' 
and only depends on the normal component of the variation vector W. By means of the divergence 
theorem, the second term can be transformed in a boundary integral given by L {W^ , ij) o''^~'^ which 
really depends only on the tangential component of W. 



Remark 2.17 (Horizontal variations). Let S <z G be a compact hypersurface of class C^ and v the 
outward-pointing unit normal vector along S. We observe that formula ^ generalizes to the following: 



(10) 



f DhsXo^^-^ ^- f n-ln {X, v^) (tT^ + r {X, TjHs ) alr^ V X e 1\H); 

Js Js JdS 



see, for instance. Corollary 3.19 and Theorem 4.3 in II56L Note that (1101) holds if either Cs - d or, if 
Cs 7^ 0, whenever X € C^(5 \Cs,H) is an admissible vector field. 

Formula (ITOl ) can be seen as a particular case of the 1st variation formula of the //-perimeter; see 
formula (|24ll in Theorem |4i6]below. Actually, note that if X - Xh € X{H), then 

X]; \Pm v\ - (X^ , v)v^ - (Xh - \Ph v\{Xh , v„)v) \Ph v\ - \Ph v\{Xm , v) (v„ - Wh v|y) 

- {Xh - {Xh , v)v^) \9h v\ ( -: Xhs \9h v|), 

where we have used the fact that v = \Vh A^H'^'^a&h ^»^a at each non-characteristic point. Now inserting 
this into dSjl yields 

LxH(y'l^ ^ {-n-lH{XH,v)+diVTs{XHs\'PHV\))(^^-^ 

= -•//« {Xh , v^ ) (t^ ' + divTs {Xhs \9h v|) . 
Hence, integrating this expression along S and using Corollary 12.81 the claim follows. 

3. Some technical preliminaries about the connection 1 -forms 

Let S c G be a hypersurface of class C^ and let L'^ c G be an open set having non-empty intersection 
with S and such that 'W := [/ n S is non-characteristic. We start with an elementary calculation. 

Lemma 3.1. We have divrs v^ = -*//« - (CCPv )y^ , "Pv v), where CiPv) := Y^aeh ^aC". 



In this case, we further assume that 35 is a («-2)-dimensional submanifold of class C' oriented by the outward unit normal 



vector ;;. 
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Proof. We have divTs v^ = div v^ - (VyV^, y>. Since div y„ = -"Hh , the thesis follows from 

<VvV«,y>=2 Z ^h/->'/3<Vx„X,-,X^> = 2] 2] v,.v.v / "^'^ ^^^ =<C(ny)y,,y^vy). 

Remark 3.2. We have 

^ ,. ,. ;^«v\ J/v«(y'«y)-<^raJ«|^«y|,y^) 

(11) - riH - divuv^ - dix'H 



\Phv\I \'Phv\ 

Since \Phv\ is Lipschitz continuous, it follows thafHn e ^igc^S ; o"^~^), but not necessarily Lj^^{S ; cr'^^). 
Note also that the last condition follows by assuming yp — r € L] (S ; cr'^~^)- 

Lemma 3.3. The following identities hold: 

(i) (/>u(Tj) ^ (p\j{Ti) + {Ch {tUh, )Ti, Ty) V /, i € Ihs / 

(ii) 4>u{t^ ) = Tiivj,) + i (c^Ti , Ti) - {C{m)T^ , Ti) VielnVaelv- 

(iii) (f>ia(Tj) = (f>jaiTi) + {C%Ti, Tj) W i, j € Ih W a € Iv ; 

(iv) T^ imp) - rj (cj J = (C(c7)tJ , t^ > Va,/3elv; 

(v) 0;a(TQ.) = "i ieln "^ a€lv; 

(vi) 0„,(t,)-O W ieln V aelv; 

(vii) 0;„(Ty) - i (Qt,-, Ty) y iJelMVaelv. 

Proof. By direct computation. In particular, using the fact that the Lie brackets of tangent vector fields 
along S is still tangent; for a detailed proof, see ll56l . n 



Lemma 3.4. The matrix of the linear operator Bh can be written out as a sum of two matrices, one 
symmetric and the other skew -symmetric, i.e. Bh - Sh + Ah, where the skew-symmetric matrix Ah is 
given by Ah = \ Ch (tith, )\hs . 

Proof. It is sufficient to apply (i) of Lemma [331 n 

Lemma 3.5. OnehasTv(Bl) = ||S«||i - WAhWI = Zj,keiHs <Pu(Tj)<pijiTk). 

Proof. We have 

^ (f>lk{Tj)(f>lj{Tk) = ^ (VrTi,Tk){VrJuTj^ 
JMIhs JMIhs 

JMIhs 

= Tr{Bl) 

- \\Sh\\1-\\Ah\\1. 

n 
Lemma 3.6. We have 'Zaeiv '^a^ns (c^ti) - 2||A«||q^ + |C«(ct«2)tiP. 
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Proof. We have 



£)«s(aTi) = Y,{^r,CUi,Tj) + {CUuCH{mH,)T:} 



J^Ihs 



= - 2, YTj''^\.,C%Tn + {C%Ti,CH{vjH2)Ti) (by linearity and skew-symmetry) 



j^lus 



where C^s := C^ I//5 . Since ( V^^.tj , Q\ Ty) = -Bh {tj, CJJ, ry) V 7 € Ihs , it follows that 

Y, ^a^Hs (C^Ti ) = J] CT„ 2] B„ (ry, C^^ Ty) + \Cm {tuh, )ti |2 
aelv aelv jslns 

= Via 2, BH{Tj,CHs{'n7H2)Tj) + \Ch{tIJH2)Ti\ , 

where Cms (juh^ ) = CwCtiraj )\hs - 2Ah ; see Lemma [X4l Therefore 



-il^ 



Y ^oGhs (Cti) = 2 2] B«(Ty,A„Ty) + |C«(cT«2)t 
aelv JsIhs 

= 2 2] ((S« + A«)Ty,A«Ty) + |C«(cT«2)t 



11^ 



= 2||A„||i+|C„(cT«2)Ti|2, 

where we have used the elementary identity Y^jeins {^ "'^j'-^"''']) ~ ^- Let us prove the last identity. For 
every j e Ihs one has 

{5.Ty,A«ry) = ^-{{Bh+BI%,(Bh-BI%) 

= \({BHrj,BHrj)-{BlWj,BlWj)). 

By summing over j e Ihs we get that Tr (5« ( • , A« •)) = \\Bh\\1, - WjWl^ - 0. n 

We now recall some identities involving the (Riemannian) curvature 2-forms O/7 associated with the 
o.n. co-frame cp (dual of r) which can be found in [56|. In particular, we need to calculate Yjjeins ^^A^' '^j^ 

YjjeiH'i (^(^'^/')^i'^7') ^^^ ^"^y ^ ^ ^H*^' which is nothing but the Ricci curvature for the partial HS- 
connection V^ . 

Lemma 3.7. We have: 

(i) (r(t;, Tj)n, n) = -l Y^aeiH, {c>i, Tj) {cZth, n) V / j, hkeln; 
(ii) (R(ryj, Ti)Tj, n) = -| i:„e/„, {C>j, n) {c^Ta, T,) V /, j,kelH,pe Ih, . 

Lemma 3.8. For every X = Xh + Xv € X{G) transversal to S , i.e. X (h S , we have the formula 

2 Oiy(X,Ty)--^ Y (C>„,C2X„)-^ Y Z ^/?(C>«,C^.). 
jelns ae/tfj o-e/tfj ySefej 

Proof Using Lemma [377] n 

Lemma 3.9. Let r = {t\,...,t„] be an adapted o.n. frame for ^ Q S on U and fix po e 1/. Then, 

we can always choose t so that the connection 1-forms (p = {(f>i, ...,0„| satisfy (ptjipo) = whenever 
i,j € Ihs = {2, ...,h}. 
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Proof. The proof follows by using a Riemannian geodesic frame. So let ^ = {^i, ...,^„) be a o.n. frame 
on U adapted to'U = UnS satisfying ^i{p) = v{p) and such that TpS = span^{^2{p), ■■■, ^nip)} for every 
p etl. Let e = |ei, ..., e„] denote its dual co-frame. 

Claim 3.10. It is always possible to choose another o.n. frame ^ on U adapted to tl satisfying: 

(i) 1(7^0) - £(Po); _ 

(ii) Let'sij := {y^i,^j) (i,j = 1, ...,n) denote the connection 1-forms of^. Then, one has'eijipo) = 
for every i,j = 2, ..., n. 



Clearly ^ = {^2, ■■■, ^n) is a tangent o.n. frame for 'W. The proof of this claim is standard; see, for instance, 
||72l . pag. 517-519, eq.(17). Now assuming that ^i{po) = t,(;?o) for every / € Ihs . In particular, we have 

EijiXp,) = {"^xjulj) (Po) = Wi,jelMs,WXe X\TS). 

By extending the o.n. frame {^2, ■■■,^h} for the horizontal tangent space HS to a full adapted frame t in 
the sense of Definition [L9j the thesis easily follows. a 

The following notion will be used throughout the proof of Lemma 1531 

Definition 3.11. Let S <z G be a hypersurface of class C (/ > 2). We say that a C^ -smooth function 
f : G — > R is a defining function for S if S = |jc € G : / = 0) and gradf 7^ for all x e S. 
Furthermore, we say that f is a normalized defining function for S (abbreviated as NDF) if, and only if, 
\gradnf\ = I for all x e S \ C5. 

Remark 3.12. Some remarks are in order First, it is not difficult to see that, given a defining function f 
for S, then a NDF f for S can simply be defined by dividing f by the magnitude of its horizontal gradient 
\grad„f\, i.e. 

~ ( f \ 8^^df 

gradf (p) ^ grad ■ — — (p) = ■ ^—77(7') ^ Vh(p) + '^(P) V peS \Cs. 

Wgrad^flj Igrad^fl 

Note that the NDF f is one order of differentiability less smooth than f. This is what happens also in 
the Euclidean case; see the book by Krantz and Parks II46II and references therein. However, at least for 
2-step Carnot groups, a normalized defining function of class C for every C -smooth hypersurface S 
(/ > 2), is given by the (signed) CC-distance function from S ; see HI. 

We end this section with a lemma, which will be important in the sequel. Let S be as above, let po & S 
and assume that, locally around pQ, S is the level set of a function f : U (zG — > R. We see that, locally 
around po, Xf = for every X e X{TS). In particular, T^{f) - for every a e Iv. As a consequence, 
by using an adapted frame t, one has Tq,(/) = rUaTiif) for every a e Iv. A normal vector along 5 in a 
neighborhood of po is given hy N :- ti(/)ti -i- Y^aeiv '''a(f)Tcv and we have v = Mr. 

Lemma 3.13. The following identities hold: 

(i) 01/Ti ) = '-^^ - (Cm (tUh, )Ti , Tj) V j € Ihs / 
(ii) <^i/T„) = \ {C",TuTj) - {C{m)T„ Tj) + ^4^ V j € Ins ^ a E ly . 

Proof We have 

[T"l,Ty] ^ ([Tl,Ty],Ti)Ti -|- ^ ([Ti , Ty], T^) T^ -l- ^ ([Ti , T^], T„) T„. 

Therefore 

[Ti,Ty](/) = -r/Ti(/)) = ([Ti,r,],ri>Ti(/) + Y, ([Ti,Ty],T„>r„(/) 

aelv 
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and this implies that 

(12) C' = ,,(n, = ([r„r,],r,> = l^ - ^ ^ (cSr„r,>. 

where we have used the identity C".-- \C'^t\,Tj). This proves (i). 
In order to prove (ii), we compute 

kelns jSe/v 



from which we get 



[Ta,Tj](f) - -t/t„(/)) = {[Ta,Tj],Ti)Ti(f) + J] ([t,„ Ty], T^) Tyj(/). 

ySe/v 



Thus 

TjiTaif)) 
Tl(/) 



^ -0lXTa) + 01ff(Ty) + 2_^ ^liC\j, 



/Se/v 

where we have used the identity C^. = (Vr^^ry, ti> - (VrjTQ,,TiV Finally, since (p\a{Tj) = \ (c%t\,tj) 
(see (vii) of Lemma [33] ). using C^- = - (C^Ta, tA it follows that 

(13) 0iy(r.) = 1 (c^-r, , r,) - J] -, (c^^r^, r,) + I^, 



2^" — / Z. ^^ -^/ ,,(/) 



as wished. 



4. Variational formulae for the //-perimeter o"^ ^ 

Below we will obtain the 1st and 2nd variation formulae for the //-perimeter measure cr'^'^. More 
precisely, we shall assume that 5 c G is of class C^, for the 1st variation formula, and that S is of class 
C^ for the 2nd variation formula. Under further hypotheses, our formulae allow to move the characteristic 
set Cs ofS. 

We stress that, in the case of the first Heisenberg group H\ a 1st variation formula for characteristic 
surfaces of class C^ was obtained by Ritore and Rosales in 1671 . Furthermore, Hurtado, Ritore and 
Rosales [44] have proved a formula for the 2nd variation of cr^"^ that is very similar to that stated in 
Theorem l4.12l below: see also the unpublished preprint [i43j . where similar results are stated in a general 
sub-Riemannian setting. 

Let S c G be a hypersurface of class C (/ = 2, 3), let L'^ c G be a relatively compact open set having 
non-empty intersection with S and set 'W := U D S . 

The following calculations are made for a bounded open subset tl oi S . In particular, we assume 
C^-regularity of dtl. Clearly, if 5 is a compact hypersurface with boundary, the formulae obtained in 
the sequel will hold for S . 

Definition 4.1. Let i : Ii ^ G denote the inclusion oftl cz S in G and let ?? :] - e, e[xtl -^ G be a 
C -smooth map, i - 2, 3. We say that ?? is a variation ofi if: 

(i) every d-f :- ^{t, •) : 1/ — > G /^ an immersion; 

(ii) &o = I. 
Moreover, we say that & keeps the boundary d^ fixed if: 

(iii) &t\att = Am for every te\-e, e[. 
The variation vector of§ (i.e. its "initial velocity") is defined by W := ^|^^q = ^*^\t=Q- 
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We shall set W :- ^ - ■d'*-^^ and assume that W is defined in a neighborhood of Im(??). For any 
"time" t e] - e, e[, let v' be the unit normal vector along 'W, := ^ti'U) and let {o-'^^)i be the Riemannian 
measure on tit- We assume that / : U — > R is a local equation for the hypersurface S near po € S and 
that /, :] - 6, e[xU — > R is a family of C'-smooth functions (/ = 2, 3) satisfying /o = / and fA'&ti^)) = t 
for every ? e] - 6, e[. In other words, the hypersurfaces tit are level sets of a defining function ft and one 
has ( V/,, w\ - 1. Choose an o.n. frame TonUcG satisfying: 

(14) Tib, =yL; HTp^t = spa.n{iT2)p,...,{n)p} '^P^'Ut; t„ = X^ 

for every t e] - e,e[. Furthermore, let := {(pi, ...,(p„] be the dual co-frame of r (i.e. (piirj) = 5^ 
for all i,j = 1, ...,«). So, we have t^ ft = 0; see Definition 1 1 .91 This implies Taif) = w[j,ti(/;), where 
^'a ■= i^TTf- Moreover, since (V/,, W) = 1, wehave vviTi(/,) + 2^„g7^, WaTaif) = l,wherewi = {w,Ty^ 

and Wa = \W,Ta)- Therefore 

r ^ 

Tl(/f) Wi + 2_^ Warn' a ^ 1- 
aelv 

Iw v'\ 1 Vj' 

Setting W( ^ ^— ^ it follows that ti(/,) = — and t„(/,) = — ^. 

The following technical result will be used in the proof of the 2nd variation of cr^"^ 
Lemma 4.2. Under the previous assumptions, we have: 

(i) ^«.> (V,.rO = -(^^^ + C„(<)ri); 
(ii) Ths, (V^„Ti) - iQri - C(:m*)Ta + gradns, m'„ - CT^. ^^tf'"'' V a € /,. 

Proo/ By applying (i) of Lemma l3.13l we get that 4>ij{T\) - --^^ - (CH{m'^^ )ti, TyV Furthermore, (ii) 
of Lemma [3.131 implies 

(15) 4>ijira) = \ {c>i,Tj) - {C{m')Ta, tj) + r/zu^) - ru[,^^ W aely. 

This achieves the proof. 

n 

General remarks. In order to discuss the variational formulae of o-'^"^, let us set 

{o-'l-^)t\- tit = (Tl J 01 A ... A 0„)|^, = (02 A ... A (f>n)\t(,. 

We also set r(0 := 7?*(02 A ... A (/>„)■ Note that F :] - e, e[xtl — > Qf^tl) defines a 1-parameter family 
of differential (n - l)-forms on tl. 

Remark 4.3. By definition, the 1st and 2nd variation formulae of o"^"' along tl are given by 

(.6) /.«W-') := ^ [l m) l- //«M-') := J (£ r<„) 

So we have a natural question: is it possible to bring the "time" derivatives inside the integral sign? 
Note that the answer is "yes "if we assume that tl is non-characteristic. Indeed, in such a case it is not 
difficulW to show that there exists e > such that the 1-parameter family F(-) of differential (n — \)-forms 
on tl is C'~^-smooth on ] - e,e[xtl. This allows us to estimate, uniformly in time, both differential 
(n - lyforms Y{t) and T{t). We will return on this point later in this section. 



f=0 



Actually, since graduf, # at f = 0, there must exist e > such that gradf,f, + for all f e] - e, e[ and hence vj^ = ,^'°^" ' , 
which is the unit //-normal along *//, = ^,(11), turns out to be of class C'"', ; = 2, 3. This implies that (o-J^"'), is C'"' -smooth. 
Therefore Yit) = i?,*(cr^"'), is C'"' -smooth. 
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Warning 4.4. Preliminarily, we need the following assumptions: 

(Ai) ifli is of class 0? there exists an integrable differential (n — \)-form Oi € n"~^('ZY), such that: 

|f(0(ti,...,t„_i)|<|Oi(ti,...,t„_i)| 

for every o.n. basis \. = {t\, ..., t„_i) ofT^. 
(A2) iftl is of class C^ there exist integrable differential (n — \)-forms Oi, O2 € Q."^^{t(), such that: 

|f(0(ti,...,t„_i)| < |Oi(ti,...,t„_i)| 

|f(0(tl,...,t„_i)| < |02(ti,...,t„_i)| 

for every o.n. basis t = {ti, ..., t„_i} ofTIA. 
1st variation. We first note that 

r r(o = r i?*(^r')r = r i^«,v'i j'aci?,^r\ 

where J'ac&i denotes the usual Jacobian of the map i?,; see fTOl . Ch. 2, § 8, pp. 46-48. Indeed, 
by definition, we have {o-"~^)t = \PM,v^\{cr"f^~^)t and hence the previous formula follows from the Area 
formula of Federer; see [29] or [.701 . Let us set f :] - e, e[x'W — > R, 

(17) fit, X) - Wh, v\x)\ Jac &t{x). 

In this case, we also set Cii := [x etl : \Ph,v'{x)\ = 0). With this notation, our original question can 
be solved by applying to / the Theorem of Differentiation under the integral; see P31 . Corollary 1.2.2, 
p. 124. More precisely, let us compute 

df d\PH,v'\ ^ djac^ 

^'^^ -dt = ^^^"^'^^^l^-'^l^^ 

/ ~ , \ , d fjac j9'f 
- {w,grad\'PH,V\) Jac-»t + \'PH,V\^^ - 

= ((W-', grad \9h, y'|) + (iV"', grad \9h, y'|) + \9h, Adivrm, w)jac &t 
= {{W^,grad \pH, v'\) + divTv, (mpH, V\)) Jac &„ 

where we have used the very definition of tangential divergence and the well-known calculation of 
^^ ' , which can be found in Chavel's book [161; see Ch.2, p.34. Now since \'Ph,v^\ is a Lipschitz 

continuous function, it follows that -^ is bounded on 7/ \ Cqj and so lies in L'^^^(1/; cr"~^). Therefore, we 
can pass the time-derivative through the integral sign. This shows that: condition {A]) in Warning \4A\ is 
always satisfied. In particular, we have proved the following 1st variation formula: 



(19) I^icrT') = f f(0) = r {{W^,grad\p,v,\) + divrv (W|^«yJ)) cr^ 



It follows from definitions that -Jj- can be regarded as the Lie derivative of {cr'l '), with respect to the 



variation vector W, that is 



df 



(20) ^ = r,L^{uT')f 

Remark 4.5. Note that formula (1201 ) can be proved exactly as in Spivak's book 11721 . Ch. 9, p. 420. As 
already mentioned in Section \Il\ this fact allows us to use some standard tools in Differential Geometry 
such as the Cartan's formula. In this way, another expression for the integrand r(0) can be derived; see, 
for instance, formula ([U). Nevertheless, this new expression it is not necessarily in LJ^^^,, with respect to 
the Riemannian measure o"^"^' see Remark \2.15\ 
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More precisely, we have 

f(0) = I* {£w«~'')t) = '* {^w(^2 A ... A 0„)) . 

By Cartan's formula 

£w(^H~')t = WJ d{(Tl-')t + diWJ{aT')t) 
and hence 

(21) f(0) = I* {WJd{cTr')r + d (WJial-'))) . 

By applying the 1st structure equation of the co-frame (p (see formula ©) we have 

n 
d«~^)t = 2<^-l)^'^2 A ... AdcPj A ... A(Pn= J] (/>lj{Tj) (pi A ... A 0„ = -CHnMcrDt, 
j=2 jelHS 

where CTYh )f := - Yijeins 'P'^Mj) - '^jeins VrjTj, v'uj is the horizontal mean curvature of 'Z/j. Note that 
we have used (v) of Lemma [331 

The calculation of the second term has been discussed in detail in Sectional see Lemma E.13[ More 
precisely, we have 

d {WJicTr')t) = divT-u, (w^\'PHy\ - <lV,/>yL^) {(Tl-')t. 
Therefore, under the previous assumptions, we have 

(22) £^{(jT')t = (-CK«),<W,/> + divT-u, (w^\'Ph,v'\ - (wyW,'')) icTr\ 

Finally, the desired formula follows by setting t = 0; see formula (E). 

Theorem 4.6 (1st variation of o"^~'). Let S <zGbe a compact hypersurface of class C with, or without, 
boundary and let ?? :] - e, e\xS -^ G be a C^-smooth variation of S. Let W - -jf\i_r. be the variation 
vector field and let Vf^ and W^ be the normal and tangential components ofW along S, respectively. 
We also setw := ,„, , . Then 

(23) Is«~') - f {{w^,grad\'PHV^\) + divrs (W|^«yJ)) a"},-'. 
Furthermore, ifhln e L'(5;cr^"^), then 

(24) Is{W,a''-^) = f -'HHW(r"-^+ ^ divrs (w^\Phv\- {W,v)vl)o-l-^ 

(25) - r [-n-lHiW^, v) + divTs (w^\Phv\ - {W^, v)vl)) (tI-\ 

*J s 

Proof Formula ^ is nothing but formula ^. Set f ^ in formula (EUl. If 'Hh € L\S ; (tI'^), then 
we can integrate this formula over S . Indeed, under such an assumption, all terms in the formula above 
turn out to be in L^{S;cr^~^). More precisely, for what concerns the term divrs (VK^|!P«v|), note that 
W^ el\TS)^C\S,TS) and that \Phv\ is Lipschitz continuous. Moreover, if -Kw e L\S;o-'^-^), the 
second term divrs Uw, v)vj 1 belongs to L^{S ; cr'^~^)- In fact, one has 

divrs ({W,v)vj) = divrs {{W,v){v„ - \Phv\v)) 
and the claim easily follows by using Lemma |3TT] Hence, we have 

Isi<-') - J f(0) = J -Cw«~%=o = / (-'^^(W,v) + divrs (w^\Phv\ - {W,v)vj)) cr'i-\ 
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Corollary 4.7. Let the assumptions of Theorem \4.6\ hold. Let dS be of class C' and let tj be the unit 
outward normal along dS . Then 

(26) IsiW,cr'r') = f -'HhWctI-' + f {(w^\Phv\ - {W,v)v^) ,Ti)cr!;r^. 



IS JdS 

Furthermore, ifW is compactly supported on S, then 



(27) 



IsiW,K~') 



f -'H^war^. 



Proof. Immediate, since the vector field Y := W^IPhv] - (W""", v)y^ is admissible (for the Riemannian 
divergence formula); see condition (♦) in Definition 12.71 In fact, we see that Y e L°°{S) and using the 
fact that 'Hh eL\S;o-^-^) yields divrs (Y) e L\S;o-"^-^). n 

2nd variation. We regard this proof as a continuation of the proof of the 1st variation formula. From 
now on, we assume 'W and S to be of class C^. Moreover, the boundary dtl (or, dS when S is compact) 
is assumed to be of class C^ We also recall that, for the 2nd variation formula, the variation ■& is assumed 
to be of class C^ on ] - e, e[xtl. 

First, let us compute the second time-derivative of the function f{t, x); see iT7]i . To this end we begin 
with formula (IT8] ). We have 

d^f 



dt^ 



d 
dt 



d\PHy\ ,.djac^ 

Jac &t + \Pm, v'\ 

dt 

d\pH,v'\dJac&t 



dt 



d^\pH,v'\ 



Jac ■&t+2 



+ \PH,V 



t, d^ 3^'^c ■&t 



dt^ dt dt ' dt^ ' 

At a first glance, it is clear that only the first term is not bounded near the characteristic set C^. More 
precisely, it is elementary to see that 



d^lpH^y'l 



dpH,v' 



dt 



dpH, v' 



dt 



,V 



d^pH.v' 



-'K 



dt^ \Ph,V*\ \ dt^ 

This shows that, in order to differentiate under the integral sign, we need the following further hypothesis: 
(A3) there exists h € L^ yU; cr^^M such that ^ — 71 < hfor every t €] — e, e[. 

Remark 4.8. Using (A3) it is not difficult to show the validity o/(A2) in Warnins \4.4\ 

We continue our proof of the 2nd variation of cr^"^ with the calculation of t{t) at a fixed non- 
characteristic point pq etl \ C^. To this end, we start from the following formula: 



(28) 



m = ^*t (J^w(^^ dial-')) + £^d(WJ(,o'l~'))). 



As already said, the 2nd time-derivative of T(f) can still be computed as a Lie derivative. Moreover, since 
d o £, = £,0 d,we have 



(29) 



r(o 



^: 



£^ (WJ d{(TT')) +d L^ (wj{(Tl-')t) 



=:A =:B 

The calculation of A = £,y^ ( VK J (3f(cr^~')J is the "hard" part of the 2nd variation formula and will be 

done in the sequel. So let us preliminarily consider the quantity B = X^(VK J(o"^"^)A (In the next 
calculations we will use the following general identity for Lie derivatives of a differential form co: 

(30) £z(YJ aj) = [Z,Y]Jco + YJ £zOJ; 

see m, Ch. 9, p. 515). We have 
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B = £^(WJ(K-'),) 



I 



= £ 



w 



{w^\pH,v'\-{W,v')v',^)j(a'i-')t 



:¥ 



(by Lemma [2.13l ) 



= [W,Y]J((r"^-')t + YJ£^(cr"^-')r (by[30l) 

= [W,Y]'^Jicrl-^)t + YJ [-{W, V){'Hk), + divT-u, {w^)){(j'n^)t (by the 1st variation of «-!)?) 

-■gi 
= ([W,YV +g;Y)A{cTl-'),. 

Therefore, the second term in formula (|29) . i.e. dB, is given by 

(31) dB = d{[[W,YV +gtY)j{o^^-\] = divTv, ([W,YV +gtY){cri-\ 

Step 0. [Divergence-type terms]. Set t - 0. First, note that [W, Y]^\ is a vector field of class C' out 
of Ci/. We also stress that 

Clearly, the first term is a vector field of class C^. The second term is the product of a C^ function times 
the vector field vj. Although not defined at C^, this term belongs to L°°. Furthermore 

By using the very definition of v^ = .p ' ^,. , we easily see that [W, v^] | can be estimated near the 
characteristic set Cii by (a constant times) the function y^—i- Continuing this argument, it is not difficult 
to realize that the tangential divergence of [W, F]^, at f = 0, i.e. divrs [W, YYV , can be estimated, 
locally around Cii, by (a constant times) the function ^ ^ . An analogous argument can be repeated for 

the second divergence-type term in formula (BTT i. In fact, since the function gt is of class C' on tit for 
all f e] - e, e[, we see that, near the characteristic set C<w, the function divTvig^Y) can be estimated by (a 
constant times) the function tut—i- 

Remark 4.9. The previous estimates show that, in order to integrate the divergence-type term dB on 1/, 
we need a further condition. More precisely, we have (at least) to require that -^ — jt e L}(^, o"r~')- 



Step 1. We start with the calculation of the term A in formula (1291 ). 

Warning 4.10. In order to simplify our calculations, hereafter we shall assume fin to be constant. 

Remark 4.11. We stress that ifHn = const., then £x'Hh = for all X € X^(TS). In particular, if 
W denotes the variation vector of {It, we have i* ( X^ CKh )t\ - £whs '^" ~ ^- Analogously, we have 
I* [£tTs CKh),] - £.^v>'Hh - Ofor all a e Iv- Hence 

(32) I* UrA'Hn ),) = I* {£^>y^ CHh),) M aelv. 
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If t = 0, we have 

- {-w'HH£^icr",-')r - Wiw)'HH -wi* (X^CK/.),)) or",'' 

= -w'Hh (-'Hh{W, v) + divTv (w^\'Phv\ - {W, y>vj)) <"! - (W(w)'K« +wi* (L^inHn))) (t"-^ 
= (l-lW - W{w)'Hh - I* (Zyjin-lH))) cr'lr' - WHndivT'u (w^\Phv\ - (W, v)v'^) (t^K 
where we have used the 1st variation of cr"'^ . 

Step 2. Setting Win :- w\v, + Wv, where Wv - Yjaeiv ^aTa, we get that 

(33) i*(£^{9(h\) = i*(£^^^{nH,)) + i*(£^^m,)) 

= I* {£^^{'Hh),) (by RemarkEIB 

= I* i^,^, {"Hm)) +Yj'* (^w„r„CH«),) 
aelv 

aelv 

Step 3. From Step 2, we see that it remains to calculate £^^, ^ {'HH)t - Wt n " ■ This will be done by 

using an adapted frame r - {ti, ...,t„) to 'ZY which satisfies Lemma [X9] at po e 1/. We also recall that 
Ti{x) - Vfj{x) for every xe^. We compute 



dvl 



Z ^K--^) 



;ete 



dT, 



2]((VnV,,ri,ry> + (v,^.ri,V,.r,» 



J^Ihs 



2 ((^r. V,,.Ti + Vr.^rjl + ^[n,r,}T,) , Tj) + J] (V.^.Ti, T,) (V,,T,-, T,) 



J^Ihs 



k=2 



= 2 -^^l/^l' ^i) + {"^r^^rJUTj) + (V[,,,,,.]Ti, T,) + £ (V.,Ti, T,,) (V,.Ty, T„) 



JsIhs 



aely 



where we have used the definition of <t>iy(ri,Ty) and the fact (Lemma [3.91 ) that (j)jk = at po € tl for 
every j, k e Ihs . We have 



kelns aelv 



kelHS 



aelv 



Moreover, using (vii) of Lemma |3.9l vields 

1 2 

{^TjTuTa) {^rjj, Ta) = <P Ya{T j)(t) jaij i) = -- (CfJTuTj) . 

Therefore, Lemma |3^ implies that 

5CK«), ^ 1 ^ |C2ti|2 + J/v«S,(V,,Ti)- Y, ((<PlMi)f+<PlkiTj)hjiTk) + {CiTuTj)(f>ljiT,)y 



dvi 



aelHr. 



j,kelHS aelv 
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Hence, from Lemma [331 Lemma [42] and formula (ITST i we get that 



UVfj 



- } |C„Ti| - diVHs, + C«(ot„ )ti 



gradhs, Wt 



Wf 



+ C«(tztJ,Jt 



+ lK||i-||5^||i 



-divHs, 



gradns, Wt 



< gradnstWi 



Wt 



+ C«(td-5,Jti - 



Wf 



+ Ch(ct„ )ti 



+ lK||i-||5^||i 






I gradHSiWt ^^ , , . 
= -diVHs, \ + Ch (w„, )ti 

Wt 



gradns, Wt ^„ , t •, ^ 



Wt 



+ \K\t-\K\\l 



+ Y, ((Cgri , CCtztOt.) - (Cgri , gradns. xu',)) + /c. « )ri , ^'^^"'' ^' 

Wt ^ 2/1 21^^^ . I 



aelv 



AnStWt 
Wt 



diVHS, (ChCtZtJ,, )Ti j - |C/y(C7j,^)Ti| 



2 I gradns, Wt 



Wt 



,C««)Ti +||Aj,||i-||5^ 



f l|2 lie' l|2 

G) 



+ ^ {{c"Ti,Ciw^)Ta) - {cIt I, gradns, m^^)) 

aelv 
Hhs, Wt 



Wt 



-Dhs, (CH{vj'^,)T,) + \\A',\t-\K\\l + Yj {{c>i,Cim')T,,)-{cUi,gradHs,Tu'„)). 



aelv 



Under the assumptions made in Warning |4.4[ Remark |48] and Warning |4.10[ we can now achieve the 
proof of the 2nd variation of o"^~^ 

Step 4. We know by Remark [Z91 that if ' ^ ^ L^{tl, o''^"^), then the function w^ is admissible; see 
Definition O Hence, if ^^ eL^{S\ o-'l^), then 

U<u{W, oT') ^ r ((w n^H f - W^wJHh -wi* (£,,, ,^ (-?/« )t)) at' 

+ f (divT-u ([W, YY[^^ + goY) - wl-lndivT-u (w^\'Phv\ - {W, v>yj)) <"> 

= f \- W{w)'Hh + w2 (CH^)^ + IIA^Ili - \\SH\t) - wZhsw 

'Dhs (Ch(ct«2)ti) + ^ ((C2Ti,C(tir)T„) - {C%Tx,gradHsTna)) 
aelv 

■ f (divTv ([W, YV[^^ + g^Y) - wl-indivTv (w^\'Phv\ - {W, v>yj)) <"! 



+w 



+ 
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= r I - W(w)'K« + w2 ({n^H? + \\Ah Hi - WShWI) + \grad^s M^ (by fomiula ©) 
(34) +w^ Yj {-^'t'Dhs (C^Ti) + {CZTuC(,m)T^) - 2 (C^Tugrad^s ma)) \ o'T^ 

aelv ' 

r (divT-u (VW, YV[^^ + goY) - wn-lndivr-u (w^YPhv] - {W, v)vl)) c^^-\ 



+ 
Using Lemma [331 yields 



'J H 



J I - W{w)^H + y? (cK«f - ||A„||i - ||5„||i) + |grac/„, wp 

+W^ 2j ~ \Ch{tUh^)Ti^ + {C"T]_,C{'UT)Ta) - 2 (C^Ti, grades -^a) 
aelv 

= r { - W{w)'Hh + w^ {cHnf - WAmWI - WShWI) + \grad,swf 
-w" Y, <(2 grades {tu^) - C{m)T^ ) , C"t,) } (t^ \ 

aelv 

where we recall that t" = Tq, - cTq,ti and that ti - v^, Tq, = Xa for any a € h; see Definition 11.91 
Finally, using the last identity in (l34l ) yields the following: 

Theorem 4.12 (2nd variation of cr^~^). Let S G G be a compact hypersurface of class Q? with, or 
without, boundary and let ?9' :] - e,e\xS -^ G be a C^ -smooth variation of S. Let W = -gf-Lf, be the 

variation vector field, let w := \p '^ and let W-^, W^ be the normal and tangential components ofW 
along S, respectively. We further assume that: 

(i) there existsQ h e L^ yll; cr^~M such that .p ^ ^,. < hfor every t e\- e, e[; 

(ii) the horizontal mean curvature I-Ih of S is constant; 

(iii) the function ^ ^ e L^ [S ; crl^^y 

Then 

lis (W, err 1) - r { - W{w)9{h + w^ (CK« )2 - \\Am \\i - \\Sh\\1) + {grades w\^ 

(35) -w^ Y <(2§raJ«, (ma) - C{m)T^) , C"v,) } cr^' 

aelv 

+ f [divTs {[W, Y]\^ + goY) - wn-lndivTs (w^|:P«y| - {W, y)vj)) cr^^ 
kJ s 

where Y := W^\'Ph,v'\ - {W,v')v'J, Y = ?|,=o and go - (-(W-^, v)'Kr + divrs W^). 

Proof. If Cs 7^ 0, then (i) implies the possibility to differentiate under the integral sign the function 
f{t, x) defined by formula (IrTT i. This has been done by using the machinery of differential forms. This 
way we have obtained (1351 ) by further assuming that I-Ih is constant. Nevertheless, we have to take care 
of the existence of the involved integrals. The integrability of the divergence-type terms has been already 
discussed at Step 0. We recall that if m^—n £ L^{S;ct'^^) it follows that all these terms are integrable. 

Clearly, the latter condition is automatically implied by (iii). Moreover, the condition ,„ ^ ,, € L^{S,o-"~^) 

implies that function w^ is admissible; see Definition 12.71 Hence, using formula Q, we see that the 
function -w JLhsw can be integrated by parts, as previously done. Furthermore, a rather tedious (but 
completely elementary) analysis shows that the same condition implies that each term in (1351 ) is integrable 



Alternatively, we can assume the validity of (A2) in Waming |4.4l 
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over S . More precisely, the integral of each of these terms can be estimated, near the characteristic set Cs , 
by (a constant times) j ,„ ^ ,4 o"^~' . (Note that these estimates follow basically from the same calculation 
performed in formula (ITlT i of Remark 13 .21 In particular, one uses the following 

([J'R{'PHV)f'- 'PhV,X) 

^"•"'1=^ — tp^^ — - 

for every X € X{G). An analogous argument was made at Step 0). This achieves the proof. n 

Corollary 4.13. Let the assumptions of Theorem \4. 12\ hold and let ■& be compactly supported on S. IfS 
is H -minimal, i.e. "Hh = 0, then 



11s{W,<tT') - f\\grad^M^-w^ \\Ah\\1 + \\Sh\\1 + ^ {{2grad^,{m,) - C{m)T^) ,C"v,) 



CT--1. 



Proof. We just have to analyze the 2nd integral in formula (|35T l. We already know that Y is admissible; 
see Corollary 14.71 Since go is C^ -smooth on S and go = on 55 , we can conclude that g^Y is admissible. 
Hence j^ divrs {goY) cr'^^ - j^^{g()Y,ri) cr",^^ = 0. Furthermore, since 'Hh = and [VK, 7]^!^^^ = on 
dS , we just have to show that [IV, F]^| is admissible. More precisely, below we shall prove that 
[W, y]^| satisfies the assumptions in Proposition 12. 1 1 1 Under our assumptions, this can be seen as 
follows. First, note that W is of class C^ on ] - e, e[xS and that Y = W'^\Ph, v'\ - (W, v')v'fj'^ is of class 
C' on ] - e, e[x(S \ Cs). Moreover, we have 

(36) = [\Ph,v'\V^W^ + WQP'^.v'lW^ - (Wi{W,v'))v',^ + iW,v')\^Y^'^^)][_^ . 

We claim that [W, Y]~'^\ e W^compC*^; TS). In fact, the first addend is Lipschitz, the second and third 
addends are in L°°, and the fourth addend can be estimated by (a constant times) m^. It is worth 
remarking that the estimate of the fourth addend relies on the fact that 

^ n- t'P"^\ ^ J^^-P/f V - v„ ® grad.„\'PHv\ 



\PhV\J \PhV\ 

In particular, under our assumptions, we have j^^ e L^(5;o"J^^'). Hence, [W, F]^| „ e L^{S',cr"^~^). 
Continuing this argument, we easily see that each tangential derivative of [W, F]^| can be estimated 
by (a constant times) ,„^ ,j and the claim follows since ,„' .^ e L^ (S; cr^~j. □ 

Notation 4.14. For the sake of simplicity, we shall set: 

(37) Srs : - ||^/.|li+||A„||i + Y, ii^grad.s i^a) - C{m)T^ ) , Cti ) . 

■, aelv 

=iiB«iii 

We stress that, unlike the Euclidean case where Sts := \\Bk ||q,. , it is not necessarily true that Sts > 0; 
an example of this fact can be found in Section [6!2l see Remark [6. 101 

Remark 4.15 (Heisenberg group; see Example 1 1.8 1 ). Let S c H" be H-minimal and set v° := -C2"^'v^. 
Then, we have 

T / dm n + \ T 

(38) Srs=\\SAl-\l-^^-—^m^ 
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5. Geometric identities for constant //-mean curvature hypersurfaces 
Lemma 5.1. Let S czG be a hypersurface of class 0? and let <p e C^(G). Then we have 

Ahs(P = Ah0 + "HfiT. (HessH0v^,v„) 

at each non-characteristic point p e S \Cs- 

Proof. First, note that we can use the invariant definition of the Laplacian on vector bundles; see, for 
instance, [15 1. So we have 



A«<^ = 2(tP-V?,t,-)(0) 



ieln 



= Tf{(P) - (V« Ti ) (<^) + A,s (P-'Hh^. 

Now we claim that t[ \(f)) - (V"jTiJ(^) = (HessH(^)y„,y„) . To prove this claim, set ti = YjIeIh ^\^i 
and compute 

rf W = 2 (TM]xm)) = Yj {Ti{A])Xi{cl>)+A]A]Xj(Xim). 



( 

Since V?jTi = i:,-je/„ 



Ti(Ai)X,-+AiA]V-X,- 



, we get that 



=0 / 



rf (0) - (v?,Ti) (0) - Yj A\A]Xj{Xim = <Hess«(0)y„, v^) , 



as wished. 



Lemma 5.2. Let S <zGbe aO? non-characteristic hypersurface of constant horizontal mean curvature 
'Hh- Then, the following identities hold: 



Hi; 



(ii) T^i^lHS {yT,'^T,Vn,Tk) ^ -((V^^V„,C«s(CT«2)Ti,) + Xae/v {C1^gradf,sma,Tk)+'J-{H <C«(CT«2)v„,Ti)- 

Bh (Ch (ct«2 )v„ , t^) j V k e Ihs . 



Proof. Throughout this proof, we use an adapted frame as in Lemma |3]9J Fix a point p e S . 
Proof of (i). Since (v„, v„) = 1 we get that (V".y„, y„\ = V / € /«s . So, we have 

i,j,kelHS iJ^Ihs 



Proof of (ii). Since {Vu,Tk) = for any /c € /«$ we get that (V".y^, t^\ = - (v„, V".t^\ for every j e Ihs . 
Therefore 

(V?, V?,y„ T,) + (V«,y„ V?,T,) = - (v?,y,, V?,t,) - (y„, V?, V?,t,) . 
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Note that V".v^ e HS and that, by our choice of the moving frame, we have (V"j'Tk) (p) = 0. Hence 

A,-:=(v?,V?,y„,T,) = -(y„, V?,V?,t,) 

= -(v„,V?_.(v?^r, + [T,-,T,]„)) 

= -(y„V?,V«T,)-(v„,V?,«[T,-,T,]„,v,)v„)) (byLemmam 
= - (y„, V?, V« T,) - Ti «[T,-, Ti]« , v^)) V /, kelHs. 
Now since ([t,-, T/t]// , vr > = ([t,-, t^], vr > - 0, we get that 

{[Ti, n], y„) ^ - ^ CTa ([r,-, Ti], Tq,) ^ - ^ CT„CJ[ ^ ^ TD-„ (C^T;, T^) ^ (C«5 (CT«2 )T;, T^) V /, /c G fe . 

Hence A, = - /v„, \/"V"ji\-Ti {{Chs {vjh^ )Ti, tu)) . Using Rh = (see Remark fOl in Section [TTI) yields 
Therefore 

-A 
We claim that A - at p. Indeed, by hypothesis, 'Hh = (Z/e/Hs ^Tji,v^) is constant. Hence we get 

th^t {TjieiHs ^rJi^'^Tk^H) = at p. Furthermore, since at ;? e S one has [Ti,Tk]H = (Cm (tithj )t,-, t^) y„ 
W i,k e Ihs , it follows that 



;e/Hi' 



^ A,- = ^ ((C«x (OT//2 )t;, Ti:) ( V^^ V„ , T,j - T; ((C«s (cTHj )t,-, T*;))) 

IS 

(V^^ V„, C«s (ra-«2 )ri:) + 2_] T; {{Chs {mH2 )Ti, Tk)) 



iSlHS 

( 



islns 



Finally, (ii) will follow from the next calculation: 

Ti {{Cms {vJh, )Ti, n)) = Y, (^'<^-) <<^"^'' ^^) + ^- ((C2 V?,T;, Ti) + {C^i, V^T^))) 



aelv 



= Xi (^'<^") <<^"^'' ^^> + ^- (- {"^".Ti, y,){CUk, v„) + {C.Ti, V„) (V?,T,, y„))) 



ffS/v 



2_^ Ti{ma){CHTi,Tk) +'Hh {CH{'njH^)v^,Tk) - BH{CH{'UJH2),Tk). 



aelv 



Using (i) of Lemma ls!2l yields the following "folklore" result: 

Proposition 5.3. Let S a G be a Q^ hypersurface of constant horizontal mean curvature 'Hh- Then, at 
each non-characteristic point p e S \Cs, we have: 

Ii; 



(i) {^AmsV^,V^J = -\\Bm 

(ii) AhsXh ='HhV^. 

Below we shall compute the //S' -laplacian Xm of the function /« := {Vh,v^), where Vh e 3£(//) is a 
constant horizontal left invariant vector field. 
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Lemma 5.4. Let S c G be C^ hypersurface of constant horizontal mean curvature "Hh. Then 

-Lhs fn - /hWEhWI,- + (Vy Vfj,CHs{'UJH2)VHSJ + ^ {C^ gradns VJ a, Vhs) + "THh (C«(C7«2)v^, Vhs) 

aelv 

at each non-characteristic point p e S \ C5. 

Proof. Fix a point p e S \Cs and choose a moving frame centered at p; see Lemma IX9l We have 
A.sfH - 2] T,r,«y„,v^)) . 2] T;((y„,V«,v„» = 2] ((y., V«,V?,v„» 

''e/H5 islHS islhs 



Ih WBhWI + ( V«^ y„ , C«5 (TU/., Whs ) + J] (C^^raJ^, m^, Vhs ) 



ffS/v 

+'7-6f (Ch {tUH2 )v„ , Vhs ) - Bh {Ch {vJH2 )v^ , Vhs ) , 

where we have used (i) and (ii) of Lemma l5.2l The thesis follows since 

Bh (Ch (vJH2 )Vjj , Vhs ) - -{Ch {'UJH2 )y„ , gradns fu ) • 

n 

A simple consequence of this lemma, at least from a "formal" point of view, is that, in general, the 
function /« cannot be an eigenfunction of a linear eigenvalue problem £,hs (p + AScp = 0, where S is 
a given smooth function on S \ C5 . This is a big difference compared with the Euclidean case where, 
for any constant vector field V € R", the function / = (V, v) is always a solution to the linear equation 

Ars ^-i-||Br||q^^ = 0. Here An is the Laplace-Beltrami operator on S and Bk is the 2nd fundamental form 
of S . This equation says that V is a Killing field of any constant mean curvature hypersurface 5 c R" ; 
see 1401 . Nevertheless, we have the following: 

Lemma 5.5. Let S aQbe aQ} hypersurface of constant horizontal mean curvature. Then 

-X,HS ma = TUaSrs W a & Iv 

at each non-characteristic point p e S \ C5. 

Proof. For the sake of simplicity, we shall assume that / is a NDF; see Definition 13.111 Let r be an 
adapted moving frame along S . We have gradnf = ti (and hence ti(/) = 1) and t^/ = tzJq, for every 
aelv. We stress that ^ = X„ (^) = X„(l) = 0. Using Lemma O yields 

Ahs VJa - AnVJa- (HcSSh (C7q.)Ti , Ti > 

= A« (Tq,/) - (HeSSH {Taf) Ti , Ti > 

= T„ ( A„ (/)) - < V,„ (Hess« (/)) n , n ) 
= TUaTx (Ah (/)) - < V,^, (Hess« (/)) n , n ) 

= -CT«TlCK«)-(Vr„(J«Tl)Tl,Tl). 

Since <(J«ti) ti, ti> = 0, we get that (V^^ HJhTi) ti),ti) = - {(JhTi) ti, V^^^ti) and hence 

<(J'//Ti)V,„Ti,Ti) + <V,„(J«Tl)Ti,Ti) = -<(J-«Ti)Ti,V^„Ti) V a € /v . 

But since ((^hTi) V^_^ti,ti) = 0, we obtain 

< Vr„ ( J"« Ti ) Ti , Ti ) = - <( J-« Ti ) Ti , V^^,Ti ) = - ( V« Ti , gradn m^) . 

By using (i) of Lemma [3.131 it follows that V",ti = -C«(cjh2)ti and so, by adding the quantity 
{Ch(vth2)ti, gradns ^a), we finally get the identity X^nsWa = -THaTx CHh). The quantity ti ("Hh) can 
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be obtained by repeating the calculations made in the proof of the 2nd variation formula. We have 

jelns »<^Iv 
= -WAnWi - WShWI - 2 {(2grad,s(ma) - CiTu)T^) ,C"t^) 

aely 
= Sts . 

n 
In Section [Ol just as an exercise, we will reprove this identity for the class of non- vertical hyperplanes 



la' ■■= {p^ exp 



• ^(V' — ^ I 



where a' e Iv; see Definition 11.111 For the sake of simplicity, this will be done only for 2-step Camot 
groups. We recall that these hyperplanes are very different from the vertical ones and, for instance, 
they turn out to be chai^acteristic at the identity e G. We now state an immediate consequence of the 
previous lemma. To this aim, let V e X{G) be a constant left invariant vector field. 

Corollary 5.6. Let S <zGbe aO? hypersurface of constant horizontal mean curvature. Then the function 
fv '.-{¥,^17) satisfies the equation -£,hs fv - fvSrs at each non-characteristic point ofS. 

6. Stability of //-minimal hypersurfaces 

Definition 6.1 (Stability). Let G be a k-step Camot group and let S c G be a H-minimal hypersurface 
of class C^. 

{S\)IfCs = %, we say that S is stable if Ilsicr'^"^) > for every C^ -smooth compactly supported 
variation d-t :] - e, e[x5 — > G. 

('^'2) If Cs ?^ 0, we further assume that p — p- € L^{S,cr^,^^). Then, we say that S is stable if 

^hifr'ir^) - ^f(^f every Q? -smooth compactly supported variation ■&! '■] — e, e[x5' — > G for 
which there exists h e L^ VU; crJ^'M such that p — —. < hfor every f €] - e, e[. 

Remark 6.2. We shall sometimes say that S is strictly stable when the stability inequality is strict. If 
Cs + 0, but we use only compactly supported variations on S* := S \ Cs, then (Si) applies to any 
non-characteristic domain Q ^ S*. 



Lemma 6.3. Let S c G be as in Definition 16. /I and let us consider the following linear eigenvalue 
problem, i.e. 

£,Hs ip -\- A Sts ip = on S 
ip = on dS . 

Under the previous assumptions, a sufficient condition for stability of S is that the first (non-trivial) 
eigenvalue Ai of this problem is greater than or equal to I; see Notation \4. 14\ 

Proof. This is an immediate consequence of the horizontal Green formula ^; see CoroUarv 12.81 

Lemma 6.4. Let S a G be a hypersurface of class Q?. Let Q. <z S* = S \ Cs be a bounded non- 
characteristic domain and let q € C(n). If there exists a smooth function t]/ > Q on Q. satisfying the 
equation £.hs (A - q^< then 

(39) ^ (\grad,s<P?+q^'')(rl-'>0 

for all smooth function ip compactly supported on Q.. 
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This lemma generalizes a well-known result in the Riemannian setting; see ll311 . 



Proof of Lemma WM If (A > satisfies Xhs ip = qip on Q., let us define a new function (p '■= logijj. By an 
elementary calculation we see that X//5 (p = q - Igrad^s <p\^- More precisely, we have 

£hs (p = divHs {gradns 4>) + (Ch (c7«2 )v„ , gradns 4>) 
( grades tp] , /„ , , gradfjs'p 



^Hsipj^ , X grades ^\\ \gradHstp? 



lA 
= q - {grades (pl^ ■ 

So let ^ be a smooth function with compact support on D.. Multiplying by -(p^ both sides of this equation 
and integrating by parts, yields 

(40) - f (p^{q-\grad„s(pf) <~^ =- [ ip^ £hs (p c/"-^ - ( 2(p {grades <P, grades (p) (jT\ 

Jo. Jo. Jo. 

where we have used Corollary 12.81 Note that 

(41) l\(p {gradns f, grades (p) I < 2\ip\\gradns if>\\gradns 4>\ ^ I'pf'IgradHs <AI^ + Igrad^s ^^ ■ 

Hence, ( [39l ) follows inserting (|4TI ) into (l40l) and canceling the terms L (f^lgrad^s <*P o"h^- ^ 

As a consequence of Lemma 15 . 5 1 and Lemma [6!4l we infer an interesting condition for stability. 

Theorem 6.5. Let S c Gbe a H-minimal hypersurface of class Q?. If there exists a e Iv such that either 
TUa > or ma < on S, then each non-characteristic domain Q.<z S* turns out to be stable. 

Proof. By applying Lemma [6!4l to the function via we immediately get the stability inequality 

IIs{W,(A~^)>0 

for every non-zero compactly supported variation ??, of 5 . n 

We have the following reformulations of Theorem [ 



Corollary 6.6. Let S <z G be a H-minimal hypersurface of class Q?. Let V € X{G) be a constant left 
invariant vector field and set fv - (V, cr). If either fv > or fv < 0, then each non-characteristic 
domain Q c S* is stable. 

Corollary 6.7. Let S cz G be a complete H-minimal hypersurface of class C^. If S is a graph with 
respect to a given vertical direction, then each non-characteristic domain Q c S* is stable. 

Below we shall study some (more or less simple) examples in order to illustrate some of our results. 

6.1. Examples. Our first example, which is that of vertical hyperplanes, is the simplest one and, to 
the best of our knowledge, the only known in literature outside the Heisenberg group setting. Roughly 
speaking, vertical hyperplanes are level-sets of linear homogeneous polynomial having (homogeneous) 
degree 1, which are ideals of the Lie algebra g. 

We claim that they are (strictly) stable hypersurfaces. This immediately follows from the fact that 
Sts = 0. Hence, for any regular bounded domain tl contained on a vertical hyperplane I, we have 
IltiiW, o"JJ"') = j^ Igradns wp cr^"' > 0, with equahty if, and only if, w = 0. 

Corollary 6.8. Let G be a k-step Carnot group. A vertical hyperplane is a C"^ -smooth non-characteristic 
strictly stable H-minimal hypersurface. 
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Now we analyze a completely different family of hyperplanes. From an intrinsic point of view, they 
are homogeneous "cones", which turn out to be characteristic at a single point. For the sake of simplicity, 
we just consider the case of 2-step Camot groups. We have g = // ® V (dim// = h, diraV - n- h). Let 
us assume that 

Xi{x) :- e, + — y \CH^i,^n)e,a, Xq, - Cq. 

aelv 

for every i € Ih = {1, .-., h} and every a € Iv = {h+ I, ..., n}, where e,j = (0, ..., 1 , ...0), j = 1..., n, is 

j-th place 

the j-th vector of the canonical basis of R" = g and xh = (xi, ..., x/,) is the horizontal position vector. As 
usual, we identify vector fields and differential operators. 

Fix a' € Iv and consider the non-vertical hyperplane I a' '■= \x - exp \Yj Xjj e G : x^' - 0\ . We have 

grad^Xa' = -\C"' Xh and so v^ = —7 — -. Moreover, m/j = for all/3 t a' and ma' - J_ . ■ Since 
divM (cUh) = Yj (^xfUH,xi) = 2 {c'^'Xj,Xj) = 

JsIh JsIh 

and 

1 \ ^a' \ _ Igrad^APiM , \ _ I Cjv, 

— ; , Cu Xh ) — — \ ; , Cu Xh ) — \ ; , 1 

y\ClxH\) I \ \C%Xh\^ I \\C",Xh\ 

it follows that 'Hh = -divnv^ = 0, i.e. Ia> is H -minimal. The above calculation also shows that 

gradn {\C"'xh\j = C^'v^j. Furthermore, we easily get that 



-Jhv^ = 



C% +y,®C%y, 



\C% Xh I 

which, in turn, implies 

/ Qs \ 

Bh (T;, Tj) = [ Ti, Tj = Ah (t,-, Tj) V i, 7 € Ins . 

\ |C^ Xh I / 

Therefore Sh - Oh (i.e. the 0-matrix on//) and ||B«||q,. - ||Ah||q, = — -. It remains to compute 

the quantity Y := - J^aeiv {{^gf^^dns i^^a) - C'(c7)tJ) , C"ti); see formula (|37] ). Since we are in a 2-step 
group, we have 

Y ^ - 2] {{2gradfjs i'uJa) + TUaC{m)T]) , C"ti) . 

aelv 

From the previous calculations, it follows that Y = and so Sts = \\Ah\\q,.. In other words, we have 



IlK(W,(T'lr') = J [igradHswl" - w^WAhWI) a^' = J Ugradnswl^ - w 



2 ||/-a' ||2 \ 
2 "^a''' US IIgi- 



< 



-1 



for any non-characteristic bounded domain tl c Ia'i= S), where cr^ ^ L la' = —^ — d£,"^ ' L la' and 

d-C^n - dxi A dX2 A ... A ... A dXa' A ... A dx^- 

It goes without saying that the previous formula holds true near the characteristic set only under the 
assumptions made in Corollary 14. 131 In particular, we have to check that L, .^^ ,4 cr^~' < -1-00, which is 
clearly equivalent to the next condition: 



(42) —^-d£V^Ia'<+^. 

J-W ic^ Xnr 

Two remarks are in order: 
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• a necessary condition for the validity of (|42] | is that the dimension of // is > 5, i.e. 
(43) h = dim// > 5; 

• in the Heisenberg group H", the previous analysis reduces to the case of the horizontal hyperplane 
{p = exp (z, f) e H" : f = 0) and, in this case, (|43] ) is also sufficient for (l42l ) to hold. 

Now let us compute 



1 \ .. r c^v, 



Abs — -, = -divHs 



\ 



'H 'H 






2|Cg'y„P ^ Zyie/^, (V?,Ti,T,)(Cg'Ty,T,) 

IQ'x«p ^ |C2'x«p 

2|Cg'y,p-||Cg;ili 
|C2'x«p 
From this computation and the very definition of Xm , it follows that 

1 \ . / 1 \ /^ . . . / 1 W WC^Msf 



■^"^ 77^' — ; = ^"*' 77^' — ; + ( ^" <^^"2 )^« ' ^'■'''^- 



'Hi- MGr 



which is equivalent to the equation £hs rua' = -'^aMAnWa,, as predicated by Lemma [531 
The previous discussion is summarized in the following: 

Corollary 6.9. Let G be a 2-step Camot group and let la' be a horizontal hyperplane passing through 
€ G. Then la' is a Q^ -smooth H-minimal hypersurface. The only characteristic point of la' is the 
identity € G. Furthermore, any bounded domain lA d la' \ {0} turns out to be strictly stable. 

6.2. An example in the Heisenberg group H". For the notation used in this section we refer the reader 
to Example II. 5 1 and Example II. 8 1 We recall that any point /? e H" is identified with (z, t) € R^"'*'^, where 
z = ixi,yi,X2,y2, ■■; x„,y„). We use the following further notation: 

v''° :- (vi, 0, V2, 0, ..., v„, 0) € r2", T^'^ := (0, vi, 0, V2, 0, ..., 0, v„) € R^" V v - (vi, V2, ..., v„) € R' 

Using this notation yields z = x^'^^+y^'^ € R^", where x = (xi,X2, ...,x„) e R" andy = (yi,y2,--;yn) £ ^"■ 
In the sequel, we shall study the following hyperbolic paraboloid: 

(44) S:={p^{z,t)em":t= ^ "■"" "^ "'"" 



First, note that grad^t = y, where z° '■= -Cjp^^z- Furthermore, a simple calculation shows that 
gradfj I t!idk!!lk I = ^ (^1.0 _ 3jO-iJ and hence v„ - ~SI'*$a > where we have set v = x + j e R". 



Therefore 

V ' + V 



V2f -V''' + tP^' ] „ V2r -1^0. -0^1 



V = 



2 I, ^Jp'^ +2{x,y)^nj " '^ \ ^jp^ + 2{x,y)^n) 

where -y^^Tjr2(^^^^)^ - \\x + yW^in andp := A/||x||g„ + \\y\^„- Clearly, the characteristic set Cs of 5 is 

the set of all points p = {z.,t) ^ S such that x + y ' = x-\-y ' = e R^". Hence p = (z, t) e Cs if, and 
only if X,- = -y,- for every / ^ 1, ..., n. Since X; ( ||^.^|,||^J ^ ¥{ (y^^^It), we easily get that divnv^ = 0, i.e. 



S is H-minimal. 
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We have m = ii— tm — and 4^ = - — ^t^-. In order to calculate the horizontal 2nd fundamental form Bh 



%" 



(and some of its invariants) we need the horizontal Jacobian matrix J'hV^j -: \ciij\. . of the //-normal 

v„. For the sake of simplicity, we treat the case n = 2, which corresponds to the 2nd Heisenberg group. 
The general case is completely analogous. We have 



a := a\\ = an = --j- \ ,,.,., ,,i 



Ik+.V||^2 



• <^2j = -<^ij for every j = 1, ...,4; 

• a^j = -a-ij for every j = 1, ...,4. 
Equivalendy, J'h v^ - 



._ „ _„ _ V2 / -(-ti+>'i)(x2+y2) 1 
- «13 - «14 - -— I ^ 



\\x+y\\\ 



f- 






a 


a 


b 


b 


-a 


-a 


-b 


-b 


Z^ 


b 


c 


c 


-ft 


-b 


-c 


—c 



It follows that y„ € KerJ'nVfj and hence Bh = -^«v„. By 



definition, we have Sh = -\ " " 2" " ~ 



a b 

-a -b 

b c 

-b -c 



So if « = 2, we have 



WBnWi = 4(^2 + 2ft2 + c2) = ^ , WShWI =2(a^ + lb" + c^) = „ ^ . = ||A«| 

^ ^ \\x + y\\l„ ^ ' IU + 3'lli. 



In the general case, an analogous calculation gives ||S«||q,. 
Therefore, using d38T i yields 



n-\ 



^and||5«||i = ||A«||i-^^. 



Sr 



||5„||i-|2^- 



5CT « + 1 



dy°. 



-VJ 



n-\ 



n+ I 



\\x + y\\l„ [\\x + y\\l„ \\x + y\\l, 
2(« - 2) 



\\x + y||R„ 
Remark 6.10 (Bts can be negative!). //■« = 1, ?/je« Bra < Ofor any non-characteristic domain tf cz S. 
The previous calculation implies that 



(45) 



IMW, 



■-""'=!(' 



I , ,2 2 2(« - 2) 



X + 3^1 Ir„ 

2n _ Ik+yll 



0-2" 



for any non-characteristic bounded domain tl cz S , where cr„ = - — j^ dz. and we have set 

dz = dxi A dyi A ... A dxn A dyn- 

Remark 6.11 (Failure of jL ,„ ^ ,4 crj^"' < -1-00 for characteristic domains). In order to apply the previous 
2nd variation formula for a characteristic domain ^ c S, we need (at least) to check that 



(46) 



r— 



y\Ln 



d£l: < +00. 



However, in general, this condition fails to hold ifC<ii + 0. 



Stable //-minimal hypersurfaces 33 



Lemma |5?T] says Ahs m = Ah-uj - (HessHtiry^, y^). Since gradnVJ = - V2 ^.3 ], we easily 

get that AhVJ - -tzt ,, "',-, . Furthermore 



1,0 



(Hess/ftiry^, v„) = 



1 


1 





... 1 


1 


1 





... 








1 


1 ... 








1 


1 ... 






X + yWin 



All together, we have shown that 



dm 2{n - 2) 

X,HS TU = Ahs vt — VJ— — = —m- 



K \\x + y\\i: 



which illustrates the content of Lemma 



Corollary 6.12. Let S = [p ^ (z, t) eW -.t = """''""'"J'^'''""^" I where z:=x^'^+f'^ € R^". Then S 
turns out to be a C^ -smooth H-minimal hypersurface. Furthermore, one has 

Cs =[p = exp (z, t)eS : Xi = -j,-, / - l,...,n}. 
Finally, any bounded domain 1( <£ S \Cs is strictly stable. 
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